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Various local search approaches have recently been applied to machine scheduling problems under multiple objectives. Their 
Oh' foremost consideration is the identification of the set of Pareto optimal alternatives. An important aspect of successfully 
' solving these problems lies in the definition of an appropriate neighbourhood structure. Unclear in this context remains, how 
interdependencies within the fitness landscape affect the resolution of the problem. 

The paper presents a study of neighbourhood search operators for multiple objective flow shop scheduling. Experiments 
have been carried out with twelve different combinations of criteria. To derive exact conclusions, small problem instances, 
for which the optimal solutions are known, have been chosen. Statistical tests show that no single neighbourhood operator is 
. able to equally identify all Pareto optimal alternatives. Significant improvements however have been obtained by hybridising 
' the solution algorithm using a randomised variable neighbourhood search technique. 
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. 1 Introduction 
p . 

, Machine scheduling considers in general the assignment of a set of resources (machines) M = {Mi, . . . , Mm} to a 
' set of jobs J = {Ji, . . . , J„}, each of which consists of a set of operations Jj — {Oji, . . . , Ojoj} [5]. The operations 
00 , Ojk typically may be processed on a single machine Mi S A4 involving a nonnegative processing time tjk- Usually, 
' precedence constraints are defined among the operations of a job, reflecting its technical nature. In the specific 
case of the here considered permutation flow shop scheduling problem, the machine sequences are identical for all 
jobs [21]. Furthermore, the sequence of the jobs on the machines is assumed to be the same, therefore leading to a 
single job permutation as a possible schedule representation. A solution of the problem, a schedule, defines starting 
' times for the tasks respecting the chosen job sequence and the defined constraints of the problem. 

Optimality of schedules can be judged with respect to a single or multiple objective functions, expressing the 
quality of the solution in a quantitative way. While the multi criteria nature of scheduling in manufacturing envi- 
ronments has been mentioned quite early [24], the problem is treated only recently as a multi objective optimisation 
problem [30]. Here, the goal is to identify all efficient alternatives, the set of Pareto optimal solutions P [31]. Most 
important optimality criteria are based on the completion times Cj of the jobs Jj in the schedule: 

• The minimisation of the maximum completion time (makespan) Cmax = max{Ci, . . . , C„}. 

• The minimisation of the sum of the completion times Csum — 

In the case of existing due dates dj for each job Jj, it is possible to compute due date violations in the form of 
tardiness values Tj — max{Cj — dj, 0}. Possible optimality criteria are: 

• The minimisation of the maximum tardiness T^ax — max{Ti, . . . , Tj}. 

• The minimisation of the total tardiness Tsum — X]?=i -^i- 
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• The minimisation of the number of tardy jobs U = J2]=i where C/, 




Tj>0 
Tj=0 



In terms of machine efficiency, idle times 7, of the machines Mj may be considered up to the completion of the last 
job. Optimality criteria are therefore: 

• The minimisation of the maximum machine idleness Imax = max{/i, ...,/„}• 

• The minimisation of the total machine idleness Isum = ^i- 

All important factor for the resolution of the permutation flow shop scheduling problem is the circumstance 
that the functions are regular [6]. It is therefore possible to map a given sequence of jobs tt = {m, . . . , 7r„} into an 
active schedule, one of which is optimal [8] . Consequently, many existing local search approaches are based on this 
idea of a schedule representation, and neighbourhood definitions manipulate the job permutations tt by changing 

the positions of jobs [23]: 

• Exchange neighbourhood (EX), exchanging the position of two jobs tTj and tt^, j ^ k. 

• Forward shift neighbourhood (FSH), removing a job ttj and reinserting it at position TTfe with k > j. 

• Backward shift neighbourhood (BSH), removing a job ttj and reinserting it at position iTk with k < j. 

• Inversion neighbourhood (INV), inverting the positions of a chosen subset of tt. 

Important applications of local search algorithms for the permutation flow shop scheduling problem comprise 
local search descent [11,23,32], simulated annealing [10,11,13,19,20,25], tabu search [22,27,33], and evolutionary 
algorithms [1-4,14,15,17,18,26]. The majority of the previously conducted studies consider the problem as a single 
objective optimisation problem with respect to the makcspan objective C„iax- Here, shift neighbourhood operators 
lead in most cases to superior results [27]. A generalisation of the conclusions with respect to multi objective 
problem settings seems however questionable, and corresponding studies have not been conducted yet. 

2 An investigation of neighbourhood operators 
2.1 Local search framework and experimental setup 

The effectiveness of local search operators for multi objective flow shop scheduling problems has been investigated 
using the framework described in algorithm 2.1 [29]. 

Algorithm 2.1 Multi Objective Local Search Descent 
1: Generate initial solution x 

2: P'^PProx ^ 

3: repeat 

4: Select X e papprox £qj. nh{x) has not been investigated yet 

5; Generate nh{x) 

6: Update P«PP™^ with all x' e nh{x) 

7: if X e P'^PP'-"^ then 

8; Mark nh{x) as 'investigated' 

9: end if 

10: until ^x G P'^PP'^"^ with nh{x) stiU to be investigated 



Starting from a random initial solution, neighbouring solutions are generated until no further improvement is 
possible. With respect to the goal of approximating a Pareto set P of alternatives, an approximation set P°-pp^°^ 
is maintained during search. The update of P°'Pp^°^ is done according to the the Pareto dominance relation, 
given in deflnition 2.1 for the chosen objective vector G{x) = {gi{x), . . . ,gk{x)). P'^pp^°^ therefore only contains 
nondominated alternatives. Solutions x' G nh{x) that dominate x lead to the removal of x from P^-pp^"^ ^ making 
step 7 after the update of P°-pp^°^ necessary. 
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Definition 2.1 (Pareto dominance): A vector of objective functions G{x) is said to dominate an vector G{x') if and 
only if Vz gi{x) < gi{x') A 3i \ gi{x) < gi{x'). 

The neighbourhood operators apphed within the framework have been fc-FSH, /c-BSH, and fc-EX. A control 
parameter k determines the number of succeeding jobs in the sequence being involved in the shift or exchange 
operation, resulting in a block shift or block exchange neighbourhood for k > 1. Settings of fc = 1, k = 2, and k = 3 
have been tested. 100 Test instances have been generated with n = m = 10 following the proposal of Taillard [28], 
and the due dates of the jobs were generated adopting the methodology of Demirkol et al. [9]. The size of the 
instances allows the determination of the true Pareto set by enumerating all possible alternatives within reasonable 
time. 



Tab. 1: Investigated combinations of optimality criteria. 
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Each neighbourhood operator has been tested on each problem instance in 100 test runs regarding twelve 
different combinations of optimality criteria as given in table 1, leading to a total of 1,080,000 local search runs. 
The approximation quality of the obtained set p^w"^ to the Pareto set P has been measured using the Di (average 
deviation of P°'Pp^°'^ to P) and £>2 (maximum deviation of P'^pp^"^ to P) metrics of CzYZAK and Jaszkiewicz [7] . 

2.2 Results 

The average results obtained by the local search operators have been investigated for statistical significance using 
a t-test at a given level of significance of 0.01. Table 2 and 3 give the number of test instances, in which a 
neighbourhood definition led to a significantly best approximation for Di and D2. 

It is possible to observe that neighbourhoods with a control parameter of fc > 1 are only superior for very 
few problem instances. Comparing 1-FSH, 1-BSH and 1-EX, no operator turns out to be the most appropriate in 
all cases. While forward shift tends to lead more frequently to significantly best results, there arc still numerous 
instances for which other operators are more favourable. It can also be noticed that this result is not primarily 
depending on the optimality criteria involved. 

On a more detailed level it is possible to observe that the identification probability of a single Pareto optimal 
alternative depends on the choice of the neighbourhood operator. To illustrate this circumstance, figure 1 plots 
for each a; e P of a problem instance, involving the optimality criteria combination 711, the frequency of its 
identification. No correlation between the identification frequencies can be seen, and the analysis reveals the 
existence of Pareto optimal alternatives which may be identified rather easily using e.g. 1-FSH while not being 
found by the 1-EX neighbourhood and vice versa. 



3 Multi Objective Variable Neighbourhood Search 



4 



Tab. 2: Significance test results for Di over all 100 test instances. 
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3 Multi Objective Variable Neighbourhood Search 
3.1 Description of the approach 

Based on the investigation presented in section 2, an improved local search approach has been proposed, described 
in algorithm 3.1. Its main idea is the randomised application of a set of neighbourhood operators to increase the 
overall identification probability of every Parcto optimal alternative. Compared with existing conc;epts of variable 
neighbourhood search [16], the applied operator is randomly chosen at every step of the algorithm from a predefined 
set of neighbourhoods. Also, only a single neighbourhood is generated, even if it is not possible to achieve further 
improvements with the selected operator. The computational complexity of this approach is therefore identical with 
the multi objective local search framework in section 2. 

The MOVNS heuristic has been applied to the 100 test instances regarding the twelve optimality criteria defi- 
nitions in 100 test runs each. Two different configurations have been considered: 

1. MOVNS/3, applying a neighbourhood from the set {1-BSH, 1-FSH, 1-EX}. 

2. MOVNS/9, selecting in each step from all nine neighbourhood definitions as given in section 2. 
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Fig. 1: Frequency of identification of Pareto optimal alternatives depending on the neighbourhood operator. 



Algorithm 3.1 Multi Objective Variable Neighbourhood Search (MOVNS) 



9: 
10 

11 



Generate initial solution x 

papprox _ 1^2; I 

repeat 

Select X e papprox Jqj. nh{x) has not been investigated yet 

Select a neighbourhood nh 
Generate nh{x) 

Update p-^pp™^ with all x' e nh{x) 
if X G P'^PP™^ then 

Mark nh{x) as 'investigated' 
end if 

until ^x G p°-Pprox nh{x) still to be investigated 



3.2 Results 

Statistical tests of significance show that MOVNS/3 is able to outperform the multi objective local search approach 
involving a single operator in most test instances. Table 4 and 5 give the number of problem instances in which 
the approach led to significantly best results for Di and D2- This behaviour does not seem to depend on the 
defined optimality criteria. For a few problem instances however, and especially for the maximum deviation D2, no 
improvements are possible. 

The configuration of MOVNS with all presented neighbourhood definitions MOVNS/9 does not lead to satisfying 
results. Integrating relatively weaker neighbourhood operators can consequently not be regarded as a promising 
concept of hybridising local search heuristics. 

The running times for the different algorithms are almost identical as the approaches differ only in terms of the 
additional choice of the neighbourhood in MOVNS. On a Intel Pentium 4 PC running at 1.8 GHz and 256 MB 
RAM, neighbouring solutions may be computed within 0.0003 milliseconds, while the evaluation of a solution takes 
0.0402 milliseconds. The comparison of the resolution behaviour of different neighbourhood operators shows no 
significant difference in terms of running time. 
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A study of local search neighbourhoods for multi objective flow shop scheduling has been presented. First experi- 
ments involving twelve different combinations of optimality criteria revealed that no single operator is superior for 
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Tab. 4: Significance test results for Di over all 100 test instances. 
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Tab. 5: Significance test results for D2 over all 100 test instances. 
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all considered problem instance. Furthermore, it has been possible to show that the identification probabiUty of a 
specific Parcto optimal alternative depends on the choice of the neighbourhood in the local search procedure. 

Improvements have been obtained in a significantly large number of test cases by applying a concept of ran- 
domised variable neighbourhood search. While the in average superior behaviour of the MOVNS approach is 
independent from the choice of the optimality criteria, a restriction to favourable neighbourhood definitions is 
necessary as weaker operators do not contribute to the quality of the obtained results. 

The study demonstrates the advantages of hybridising traditional local search techniques with multi neighbour- 
hood strategies. This is especially of importance as in the proposed setting of alternatively selecting operators the 
computational complexity of the approach is not increased while superior results are obtained. 
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